One more trip to Barcetona: on the special status of visual similarity effects in city names.

Previous research has shown that, unlike misspelled common words, misspelled brand names are sensitive to visual letter similarity effects (e.g., amazom is often recognized as a legitimate brand name, but not amazot). This pattern poses problems for those models that assume that word identification is exclusively based on abstract codes. Here, we investigated the role of visual letter similarity using another type of word often presented in a more homogenous format than common words: city names. We found a visual letter similarity effect for misspelled city names (e.g., Barcetona was often recognized as a word, but not Barcesona) for relatively short durations of the stimuli (200 ms; Experiment 2), but not when the stimuli were presented until response (Experiment 1). Notably, misspelled common words did not show a visual letter similarity effect for brief 200- and 150-ms durations (e.g., votume was not as often recognized as a word than vosume; Experiments 3-4). These findings provide further evidence that the consistency in the format of presentations may shape the representation of words in the mental lexicon, which may be more salient in scenarios where processing resources are limited (e.g., brief exposure presentations).

How do face masks impact communication amongst deaf/HoH people?

Face coverings have been key in reducing the spread of COVID-19. At the same time, they have hindered interpersonal communication, particularly for those who rely on speechreading to aid communication. The available research indicated that deaf/hard of hearing (HoH) people experienced great difficulty communicating with people wearing masks and negative effects on wellbeing. Here we extended these findings by exploring which factors predict deaf/HoH people's communication difficulties, loss of information, and wellbeing. We also explored the factors predicting perceived usefulness of transparent face coverings and alternative ways of communicating. We report the findings from an accessible survey study, released in two written and three signed languages. Responses from 395 deaf/HoH UK and Spanish residents were collected online at a time when masks were mandatory. We investigated whether onset and level of deafness, knowledge of sign language, speechreading fluency, and country of residence predicted communication difficulties, wellbeing, and degree to which transparent face coverings were considered useful. Overall, deaf/HoH people and their relatives used masks most of the time despite greater communication difficulties. Late-onset deaf people were the group that experienced more difficulties in communication, and also reported lower wellbeing. However, both early- and late-onset deaf people reported missing more information and feeling more disconnected from society than HoH people. Finally, signers valued transparent face shields more positively than non-signers. The latter suggests that, while seeing the lips is positive to everyone, signers appreciate seeing the whole facial expression. Importantly, our data also revealed the importance of visual communication other than speechreading to facilitate face-to-face interactions.

Inconsistent language lateralisation - Testing the dissociable language laterality hypothesis using behaviour and lateralised cerebral blood flow.

BACKGROUND: Most people have strong left-brain lateralisation for language, with a minority showing right- or bilateral language representation. On some receptive language tasks, however, lateralisation appears to be reduced or absent. This contrasting pattern raises the question of whether and how language laterality may fractionate within individuals. Building on our prior work, we postulated (a) that there can be dissociations in lateralisation of different components of language, and (b) these would be more common in left-handers. A subsidiary hypothesis was that laterality indices will cluster according to two underlying factors corresponding to whether they involve generation of words or sentences, versus receptive language. METHODS: We tested these predictions in two stages: At Step 1 an online laterality battery (Dichotic listening, Rhyme Decision and Word Comprehension) was given to 621 individuals (56% left-handers); At Step 2, functional transcranial Doppler ultrasound (fTCD) was used with 230 of these individuals (51% left-handers). 108 left-handers and 101 right-handers gave useable data on a battery of three language generation and three receptive language tasks. RESULTS: Neither the online nor fTCD measures supported the notion of a single language laterality factor. In general, for both online and fTCD measures, tests of language generation were left-lateralised. In contrast, the receptive tasks were at best weakly left-lateralised or, in the case of Word Comprehension, slightly right-lateralised. The online measures were only weakly correlated, if at all, with fTCD measures. Most of the fTCD measures had split-half reliabilities of at least .7, and showed a distinctive pattern of intercorrelation, supporting a modified two-factor model in which Phonological Decision (generation) and Sentence Decision (reception) loaded on both factors. The same factor structure fitted data from left- and right-handers, but mean scores on the two factors were lower (less left-lateralised) in left-handers. CONCLUSIONS: There are at least two factors influencing language lateralization in individuals, but they do not correspond neatly to language generation and comprehension. Future fMRI studies could help clarify how far they reflect activity in specific brain regions.

The impact of visual cues during visual word recognition in deaf readers: An ERP study.

Although evidence is still scarce, recent research suggests key differences in how deaf and hearing readers use visual information during visual word recognition. Here we compared the time course of lexical access in deaf and hearing readers of similar reading ability. We also investigated whether one visual property of words, the outline-shape, modulates visual word recognition differently in both groups. We recorded the EEG signal of twenty deaf and twenty hearing readers while they performed a lexical decision task. In addition to the effect of lexicality, we assessed the impact of outline-shape by contrasting responses to pseudowords with an outline-shape that was consistent (e.g., mofor) or inconsistent (e.g., mosor) with their baseword (motor). Despite hearing readers having higher phonological abilities, results showed a remarkably similar time course of the lexicality effect in deaf and hearing readers. We also found that only for deaf readers, inconsistent-shape pseudowords (e.g., mosor) elicited larger amplitude ERPs than consistent-shape pseudowords (e.g., mofor) from 150 ms after stimulus onset and extending into the N400 time window. This latter finding supports the view that deaf readers rely more on visual characteristics than typical hearing readers during visual word recognition. Altogether, our results suggest different mechanisms underlying effective word recognition in deaf and hearing readers.

The time course of processing handwritten words: An ERP investigation.

Behavioral studies have shown that the legibility of handwritten script hinders visual word recognition. Furthermore, when compared with printed words, lexical effects (e.g., word-frequency effect) are magnified for less intelligible (difficult) handwriting (Barnhart and Goldinger, 2010; Perea et al., 2016). This boost has been interpreted in terms of greater influence of top-down mechanisms during visual word recognition. In the present experiment, we registered the participants' ERPs to uncover top-down processing effects on early perceptual encoding. Participants' behavioral and EEG responses were recorded to high- and low-frequency words that varied in script's legibility (printed, easy handwritten, difficult handwritten) in a lexical decision experiment. Behavioral results replicated previous findings: word-frequency effects were larger in difficult handwriting than in easy handwritten or printed conditions. Critically, the ERP data showed an early effect of word-frequency in the N170 that was restricted to the difficult-to-read handwritten condition. These results are interpreted in terms of increased attentional deployment when the bottom-up signal is weak (difficult handwritten stimuli). This attentional boost would enhance top-down effects (e.g., lexical effects) in the early stages of visual word processing.

Sign and Speech Share Partially Overlapping Conceptual Representations.

Conceptual knowledge is fundamental to human cognition. Yet, the extent to which it is influenced by language is unclear. Studies of semantic processing show that similar neural patterns are evoked by the same concepts presented in different modalities (e.g., spoken words and pictures or text) [1-3]. This suggests that conceptual representations are "modality independent." However, an alternative possibility is that the similarity reflects retrieval of common spoken language representations. Indeed, in hearing spoken language users, text and spoken language are co-dependent [4, 5], and pictures are encoded via visual and verbal routes [6]. A parallel approach investigating semantic cognition shows that bilinguals activate similar patterns for the same words in their different languages [7, 8]. This suggests that conceptual representations are "language independent." However, this has only been tested in spoken language bilinguals. If different languages evoke different conceptual representations, this should be most apparent comparing languages that differ greatly in structure. Hearing people with signing deaf parents are bilingual in sign and speech: languages conveyed in different modalities. Here, we test the influence of modality and bilingualism on conceptual representation by comparing semantic representations elicited by spoken British English and British Sign Language in hearing early, sign-speech bilinguals. We show that representations of semantic categories are shared for sign and speech, but not for individual spoken words and signs. This provides evidence for partially shared representations for sign and speech and shows that language acts as a subtle filter through which we understand and interact with the world.

Deaf readers benefit from lexical feedback during orthographic processing.

It has been proposed that poor reading abilities in deaf readers might be related to weak connections between the orthographic and lexical-semantic levels of processing. Here we used event related potentials (ERPs), known for their excellent time resolution, to examine whether lexical feedback modulates early orthographic processing. Twenty congenitally deaf readers made lexical decisions to target words and pseudowords. Each of those target stimuli could be preceded by a briefly presented matched-case or mismatched-case identity prime (e.g., ALTAR-ALTAR vs. altar- ALTAR). Results showed an early effect of case overlap at the N/P150 for all targets. Critically, this effect disappeared for words but not for pseudowords, at the N250-an ERP component sensitive to orthographic processing. This dissociation in the effect of case for word and pseudowords targets provides strong evidence of early automatic lexical-semantic feedback modulating orthographic processing in deaf readers. Interestingly, despite the dissociation found in the ERP data, behavioural responses to words still benefited from the physical overlap between prime and target, particularly in less skilled readers and those with less experience with words. Overall, our results support the idea that skilled deaf readers have a stronger connection between the orthographic and the lexical-semantic levels of processing.

Cerebral lateralisation during signed and spoken language production in children born deaf.

The effect of sensory experience on hemispheric specialisation for language production is not well understood. Children born deaf, including those who have cochlear implants, have drastically different perceptual experiences of language than their hearing peers. Using functional transcranial Doppler sonography (fTCD), we measured lateralisation during language production in a heterogeneous group of 19 deaf children and in 19 hearing children, matched on language ability. In children born deaf, we observed significant left lateralisation during language production (British Sign Language, spoken English, or a combination of languages). There was no difference in the strength of lateralisation between deaf and hearing groups. Comparable proportions of children were categorised as left-, right-, or not significantly-lateralised in each group. Moreover, an exploratory subgroup analysis showed no significant difference in lateralisation between deaf children with cochlear implants and those without. These data suggest that the processes underpinning language production remain robustly left lateralised regardless of sensory language experience.

Tracking the time course of letter visual-similarity effects during word recognition: A masked priming ERP investigation.

Visual similarity effects during the early stages of word processing have been consistently found for letter-like digits and symbols. However, despite its relevance for models of word recognition, evidence for letter visual-similarity effects is scarce and restricted to behavioral experiments. In two masked priming experiments, we measured event-related potential (ERP) responses to words preceded by an identical (dentist-DENTIST), a visually similar (dentjst-DENTIST), or a visually dissimilar prime (dentgst-DENTIST) to track the time course of the effects of letter visual-similarity during word processing. In the 230- to 350-ms time window, the ERPs in the visual dissimilar condition showed larger negative-going amplitudes than in the visual similar condition, which in turn behaved like the identity condition. In a later time window (400-500 ms), the visually similar condition elicited larger negative-going amplitudes than the identity condition. This pattern of findings can be accommodated within those models of word recognition that assume uncertainty concerning letter identities early in word processing that is resolved over time.

Early use of phonological codes in deaf readers: An ERP study.

Previous studies suggest that deaf readers use phonological information of words when it is explicitly demanded by the task itself. However, whether phonological encoding is automatic remains controversial. The present experiment examined whether adult congenitally deaf readers show evidence of automatic use of phonological information during visual word recognition. In an ERP masked priming lexical decision experiment, deaf participants responded to target words preceded by a pseudohomophone (koral - CORAL) or an orthographic control prime (toral - CORAL). Responses were faster for the pseudohomophone than for the orthographic control condition. The N250 and N400 amplitudes were reduced for the pseudohomophone when compared to the orthographic control condition. Furthermore, the magnitude of both the behavioral and the ERP pseudohomophone effects in deaf readers was similar to that of a group of well-matched hearing controls. These findings reveal that phonological encoding is available to deaf readers from the early stages of visual word recognition. Finally, the pattern of correlations of phonological priming with reading ability suggested that the amount of sub-lexical use of phonological information could be a main contributor to reading ability for hearing but not for deaf readers.

Examining the contribution of motor movement and language dominance to increased left lateralization during sign generation in native signers.

The neural systems supporting speech and sign processing are very similar, although not identical. In a previous fTCD study of hearing native signers (Gutierrez-Sigut, Daws, et al., 2015) we found stronger left lateralization for sign than speech. Given that this increased lateralization could not be explained by hand movement alone, the contribution of motor movement versus 'linguistic' processes to the strength of hemispheric lateralization during sign production remains unclear. Here we directly contrast lateralization strength of covert versus overt signing during phonological and semantic fluency tasks. To address the possibility that hearing native signers' elevated lateralization indices (LIs) were due to performing a task in their less dominant language, here we test deaf native signers, whose dominant language is British Sign Language (BSL). Signers were more strongly left lateralized for overt than covert sign generation. However, the strength of lateralization was not correlated with the amount of time producing movements of the right hand. Comparisons with previous data from hearing native English speakers suggest stronger laterality indices for sign than speech in both covert and overt tasks. This increased left lateralization may be driven by specific properties of sign production such as the increased use of self-monitoring mechanisms or the nature of phonological encoding of signs.

Cerebral lateralisation of first and second languages in bilinguals assessed using functional transcranial Doppler ultrasound.

Background: Lateralised representation of language in monolinguals is a well-established finding, but the situation is much less clear when there is more than one language. Studies to date have identified a number of factors that might influence the brain organisation of language in bilinguals. These include proficiency, age of acquisition and exposure to the second language. The question as to whether the cerebral lateralisation of first and second languages are the same or different is as yet unresolved. Methods: We used functional transcranial Doppler sonography (FTCD) to measure cerebral lateralisation in the first and second languages in 26 high proficiency bilinguals with German or French as their first language (L1) and English as their second language (L2). FTCD was used to measure task-dependent blood flow velocity changes in the left and right middle cerebral arteries during word generation cued by single letters. Language history measures and handedness were assessed through self-report questionnaires. Results:The majority of participants were significantly left lateralised for both L1 and L2, with no significant difference in the size of asymmetry indices between L1 and L2. Asymmetry indices for L1 and L2 were not related to language history, such as proficiency of the L2. Conclusion:  In highly proficient bilinguals, there is strong concordance for cerebral lateralisation of first and second languages.

LSE-Sign: A lexical database for Spanish Sign Language.

The LSE-Sign database is a free online tool for selecting Spanish Sign Language stimulus materials to be used in experiments. It contains 2,400 individual signs taken from a recent standardized LSE dictionary, and a further 2,700 related nonsigns. Each entry is coded for a wide range of grammatical, phonological, and articulatory information, including handshape, location, movement, and non-manual elements. The database is accessible via a graphically based search facility which is highly flexible both in terms of the search options available and the way the results are displayed. LSE-Sign is available at the following website: http://www.bcbl.eu/databases/lse/.

Language lateralization of hearing native signers: A functional transcranial Doppler sonography (fTCD) study of speech and sign production.

Neuroimaging studies suggest greater involvement of the left parietal lobe in sign language compared to speech production. This stronger activation might be linked to the specific demands of sign encoding and proprioceptive monitoring. In Experiment 1 we investigate hemispheric lateralization during sign and speech generation in hearing native users of English and British Sign Language (BSL). Participants exhibited stronger lateralization during BSL than English production. In Experiment 2 we investigated whether this increased lateralization index could be due exclusively to the higher motoric demands of sign production. Sign naïve participants performed a phonological fluency task in English and a non-sign repetition task. Participants were left lateralized in the phonological fluency task but there was no consistent pattern of lateralization for the non-sign repetition in these hearing non-signers. The current data demonstrate stronger left hemisphere lateralization for producing signs than speech, which was not primarily driven by motoric articulatory demands.

Stimulus rate increases lateralisation in linguistic and non-linguistic tasks measured by functional transcranial Doppler sonography.

Studies to date that have used fTCD to examine language lateralisation have predominantly used word or sentence generation tasks. Here we sought to further assess the sensitivity of fTCD to language lateralisation by using a metalinguistic task which does not involve novel speech generation: rhyme judgement in response to written words. Line array judgement was included as a non-linguistic visuospatial task to examine the relative strength of left and right hemisphere lateralisation within the same individuals when output requirements of the tasks are matched. These externally paced tasks allowed us to manipulate the number of stimuli presented to participants and thus assess the influence of pace on the strength of lateralisation. In Experiment 1, 28 right-handed adults participated in rhyme and line array judgement tasks and showed reliable left and right lateralisation at the group level for each task, respectively. In Experiment 2 we increased the pace of the tasks, presenting more stimuli per trial. We measured laterality indices (LIs) from 18 participants who performed both linguistic and non-linguistic judgement tasks during the original 'slow' presentation rate (5 judgements per trial) and a fast presentation rate (10 judgements per trial). The increase in pace led to increased strength of lateralisation in both the rhyme and line conditions. Our results demonstrate for the first time that fTCD is sensitive to the left lateralised processes involved in metalinguistic judgements. Our data also suggest that changes in the strength of language lateralisation, as measured by fTCD, are not driven by articulatory demands alone. The current results suggest that at least one aspect of task difficulty, the pace of stimulus presentation, influences the strength of lateralisation during both linguistic and non-linguistic tasks.

Investigating language lateralization during phonological and semantic fluency tasks using functional transcranial Doppler sonography.

Although there is consensus that the left hemisphere plays a critical role in language processing, some questions remain. Here we examine the influence of overt versus covert speech production on lateralization, the relationship between lateralization and behavioural measures of language performance and the strength of lateralization across the subcomponents of language. The present study used functional transcranial Doppler sonography (fTCD) to investigate lateralization of phonological and semantic fluency during both overt and covert word generation in right-handed adults. The laterality index (LI) was left lateralized in all conditions, and there was no difference in the strength of LI between overt and covert speech. This supports the validity of using overt speech in fTCD studies, another benefit of which is a reliable measure of speech production.

An ERP study of coreference in Spanish: semantic and grammatical gender cues.

We report two event-related potentials (ERPs) experiments aimed to investigate the roles played by semantic and syntactic information during pronoun resolution. The first experiment was designed to show that ambiguity of the pronoun (e.g., word class ambiguity) makes an important contribution to the pattern observed in previous ERP studies. As expected, the results showed a different ERP pattern for ambiguous and nonambiguous pronouns. The second experiment analyzed pronoun resolution when gender agreement and animacy were manipulated, using only unambiguous pronouns. Results showed P600 effects at 500 to 700 ms and at 700 to 900 ms. Amplitude of the second window was significantly greater for animate than for inanimate antecedents. The modulation of the agreement effect by animacy suggests that repair processes after grammatical disagreement detection are influenced by semantics.

Lexical access in Catalan Signed Language (LSC) production.

This paper investigates whether the semantic and phonological levels in speech production are specific to spoken languages or universal across modalities. We examined semantic and phonological effects during Catalan Signed Language (LSC: Llengua de Signes Catalana) production using an adaptation of the picture-word interference task: native and non-native signers were asked to sign picture names while ignoring signs produced in the background. The results showed semantic interference effects for semantically related distractor signs and phonological facilitation effects when target signs and distractor signs shared either Handshape or Movement but phonological interference effects when target and distractor shared Location. The results suggest that the general distinction between semantic and phonological levels seems to hold across modalities. However, differences in sign language and spoken production become evident in the mechanisms underlying phonological encoding, shown by the different role that Location, Handshape, and Movement play during phonological encoding in sign language.